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Abstract 

Functions of some networks, such as power grids and large-scale brain networks, rely on not only fre- 
quency synchronization, but also phase synchronization. Nevertheless, even after the oscillators reach 
to frequency-synchronized status, phase difference among oscillators often shows non-zero constant 
values. Such phase difference potentially results in inefficient transfer of power or information among 
oscillators, and avoid proper and efficient functioning of the network. In the present study, we newly 
define synchronization cost by the phase difference among the frequency-synchronized oscillators, and 
investigate the optimal network structure with the minimum synchronization cost through rewiring- 
based optimization. By using the Kuramoto model, we demonstrate that the cost is minimized in 
a network topology with rich-club organization, which comprises the densely-connected center nodes 
and peripheral nodes connecting with the center module. We also show that the network topology is 
characterized by its bimodal degree distribution, which is quantified by Wolfson's polarization index. 
Furthermore, we provide analytical interpretation on why the rich-club network topology is related to 
the small amount of synchronization cost. 



* takawatanabe-tky@umin.ac.jp 



1 



I. INTRODUCTION 



As power grids 

HQ 

and networks of bursting neurons [3|, |4j, functions of some complex 
networks of oscillators are based on not only synchronization of frequencies of the oscillators, 
but also synchronization of their phases. However, in general, frequency synchronization is 
more achievable than phase synchronization. Phase difference among frequency-synchronized 
oscillators often falls into a non-zero constant, and such non-zero phase difference would avoid 
proper and efficient functioning of the complex networks. 

In power grids, alternating voltage of the power plants in the grids should be synchronized 
around certain specific frequency (e.g., 50 Hz in the most parts of Europe and 60 Hz in the 
north America) [l| , and disruption of the frequency synchronization causes a blackout in a large 
area . In addition, the phases of the voltages of the power plants are also required to be 
synchronized. As discussed in Appendix |A], the difference in voltagephases among power plants 
inevitably causes power loss consumed as heat in power lines [2| • In this sense, the phase 
difference in power grids can be regarded as synchronization cost. Consideringrecent increasing 
environmental awareness and soaring global demand of natural resources 6|, |7|, it is necessary 
to reduce the synchronization cost due to the phase difference among frequency-synchronized 
power plants. 

Synchronization in large-scale brain networks also requires less difference in phase of neu- 
ronal activity among different brain regions. A series of prior experimental researches have 
shown that various important functions in large-scale brain networks are based on not only 
frequency- but also phase- synchronization 0, 4\. A previous electrophysiological study showed 
that spike activity recorded from monkeys' cortex exhibited phase synchronization in various 
frequency bands while the monkeys were conducting tasks that required integration of visual 
processing and motor responses [8(. In another careful electrophysiology study, Roelfsema 
and his colleagues recorded local field potentials (LFP) in the cerebral cortex in cats, and re- 
vealed that phase synchronization between LFPs recorded in the visual and parietal cortices 
was increased only when the cats focused their attention on stimuli [9|. Studies using electro- 
encephalogram to record human brain activity found that increase of phase synchronization in 



various frequency was associated with learning and perception of images lOj, Furthermore 



he frequency- and phase- synchronization are considered to occur in large-scale brain networks 



12] with zero time-lag 



syncn 



131 ] . These researches suggest that phase synchronization in 
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large-scale brain networks is related to crucial functions such as integration of multiple infor- 
mation jjj], neural communication [ijj], and spike-timing-dependent plasticity {4]. Actually, it 
is known that some types of the disruption of the synchronization cause dysfunctions of mem- 
ory learning [ljj] or psychiatric disorders jl6 |. Considering these findings, it is to some extent 
reasonable to hypothesize that large-scale brain networks have a specific organization that min- 
imizes phase differences among brain activity, and enables optimal phase synchronization in 
the entire networks. 

These previous literatures indicate the importance to reduce phase difference among 
frequency-synchronized oscillators, which can be regarded as a type of cost that is spent during 
synchronization. However, little is examined about the optimal network topology that reduces 
this type of synchronization cost due to phase difference. Indeed, a series of previous literatures 
have investigated optimal network structures by introducing a different type of synchronization 
cost, which is needed for building or maintain of the optimal network infrastructure. A study 
regarded parameters based on coupling strength among oscillators as a cost, and demonstrated 
that homogeneous and uniform distribution of the coupling strength enhances the tendency 
of synchronization [lTl j . Another study employing the same definition of synchronization cost 
suggests that more heterogeneous network structures are required to simultaneously achieve 
both the maximum synchronizability and minimum synchronization cost based on coupling 
strength [l^]. Another study revealed the optimal distribution of coupling strength that in- 
creases synchronizability among Kuramoto oscillators 19] . However, these prior researches 



have not focused on synchronization cost due to phase difference. Con seq uently, despite a line 



of prior researches on optimal conditions for synchrony in networks |20|, it remains unclear 
about optimal network structures that minimize synchronization cost due to phase difference 
among oscillators. 

In the present study, therefore, we examine the optimal network topology to minimize the 
phase-difference-based synchronization cost. We take the following five steps: 

(i) First, we define the synchronization cost, SV,-, due to phase difference between frequency- 
synchronized phase oscillators % and j in the Kuramoto model. We adopt the Kuramoto 
model because the model has been used as approximation of various systems including 



power grids [2|, |2l|, |22[ and large-scale brain networks [23|, \24 \. 



(ii) Second, by using the definition, we numerically calculate the mean of synchronization 
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cost, (S), in the entire network. 



24 



26428 



iii) Third, by using a rewiring strategy |25|, we show that "rich-club" network topology 



which consists of densely inter-connected modules and peripheral low-degree 



nodes, is the optimal topology with the minimum synchronization cost. 

(iv) Forth, we characterize the rich-club network topology by quantifying the bimodality of 
the degree distribution of the network. 

(v) Finally, we provide an analytical interpretation on why the rich-club network organization 
is associated with a small amount of the synchronization cost. 



II. METHOD 



A. Definition of synchronization cost 

We first define synchronization cost due to phase difference in an unweighted and undirected 
network which is described by an adjacency matrix A and consists of N phase oscillators. Ay- 
is 1 when oscillators i and j are connected, and Ay is when they are not. According to the 
Kuramoto model, the phase of the oscillator i, 9i, is described as 

Qi = ujj - e Aij sin(0; - 8j), (1) 
j 

where Ui is the natural frequency of the oscillator i, and e is a coupling strength. To reduce 
computational cost for the following rewiring-based optimization, we assume that e is constant 
for any combination of oscillators. In this Kuramoto model, the synchronization cost between 
oscillators % and j, Sij is defined based on the phase difference between the connected oscillators 
as follows: 

S ij = {6 i -6 j ) 2 . (2) 

Note that the synchronization cost is only defined after the network of the oscillators reaches 
to a state of frequency synchronization. As described in Appendix 13 in power grids, can 
be regarded as an index that is proportional to power loss due to difference in voltage phase 
between power plants i and j. 



4 



B. Estimation of the mean synchronization cost 



Based on the definition of S^, we numerically estimate S^ for each edge in the following 
four steps for a given network: 

(i) We set normally-distributed {ui} for each node. It is because that previous studies on 
real networks such as power grids and brain networks have assumed that the natural 
belonging oscillators are symmetrically fluctuating around the averaged 



frequencies o: 
frequency j^, 



22 



29] 



(ii) Based on the Kuramoto model described in Eq. (pQ), we numerically estimate frequency- 
synchronized status, where 9i becomes a common constant value, Q, for any i. 

(iii) In the frequency-synchronized status, each oscillator has a different specific phase, #j. 
Based on the set of we then evaluate S^ for each edge. 

(iv) As described in (i), the set of the natural frequency, {oJi}, is fluctuating over time. Thus, 
the is also fluctuating over time. Therefore, we repeat the procedure (i)-(iii) 200 times 
with different sets of {cjj}, and obtain 200 different sets of {<%}■ Then, we average the 
{Sij} over time, obtaining (S^) for each edge. Finally, we average the (Sij) across edges, 
and obtain (S) for the entire network. 



C. Rewiring-based optimization 

To search for the optimal network topology with the least (S), we adopt the rewiring method 
■;hat previous studies used to explore the network topology with the largest synchronizability 



25[. We apply the following rewiring-based optimization procedure to a given connected net- 
work with N nodes and mean degree of (k): At each step, the number of rewired edges is ran- 
domly determined based on an exponential distribution. The set of edges to be rewired is also 
randomly chosen in a given network. After the rewiring, we estimate frequency-synchronized 
status and obtain (S) updated . The attempted rewiring is rejected if the updated network is 
disconnected. Otherwise, the rewiring is accepted if A (S) = (5 , ) updatcd — (^initial < 0' or with 



probabi 
<Z= -3 



ityp = min(l,[l-(l-g)A(S) /TjVC 1 -?)) where T is a temperature-like parameter and 



251 ] . The initial rewiring is conducted at T = oo, and, after the first N rewiring, T is set 



as (1 — q)(A (S)) max where (A (S)) max is the largest A (S) in the first N rewiring trials. After 



that, T is decreased 10% in every 10 rewiring trials. This estimation process iterated until there 
is no change in more than 50 successive rewiring steps. We apply this rewiring-based optimiza- 
tion to three different initial networks: an Erdos-Renyi (ER) random model, Watts-Strogatz 



25|. In 



(WS) model |30(], and a Barabasi- Albert (BA) model [3J| with N = 50 and (k) = 4 
all the cases, the coupling strength, e, is set to be 0.3. Each set of the natural frequencies of 
Kuramoto oscillators, {uJi}, is randomly chosen from the normal distribution with an average 
of 1007T and a standard deviation of 1. 

During the optimization, we trace the standard order parameter, r, and local synchoroniz- 
ability, ri oca i [32|, defined as follows: 



re 



N 4^ 



'"local 



2N, 



lim — 

At->oo At 



.10, 



t r +At 



z m(t)-e 3 {t)\ dt 



(3) 



(4) 



where Ni is the total number of edges, Tj is the set of neighbors of node i, and ip is a global 
phase. Furthermore, after the optimization is completed, we compare the optimized networks 
from the different initial networks by estimating the following basic topological properties: mean 



of shortest path length 33j , mean of clustering coefficient 30j , mean of betweenness centrality 



34j . and degree correlation 34j. We conducted ten optimizations of ten different networks for 



each type of the initial networks, and averaged these basic properties. 

The shortest path length, is defined as the shortest distance between two nodes i and 



J 



331 ] . The averaged shortest path length, (£), is defined as the average value of £ij over 



all the possible pairs of nodes in the network. 



The clustering coefficient for node i, Q, measures the local group cohesiveness (30|, which 
is defined as the ratio of the number of links between the neighbors of i and the maximum 
number of such links. We define the mean clustering coefficient, (C), as an average value 
over all the nodes. 

The betweenness centrality for node i, bi, is defined as the number of shortest paths be- 



34j . We define the mean betweenness 



tween pairs of nodes that pass through a given node 
centrality, (b), as an average value over all the nodes. 

The degree correlation for a network is defined as the Pearson assortativity coefficient 



of the degrees, r assortativc 



341 ] . The coefficient enables us to quantify the preference for 



high-degree nodes to attach to other high-degree nodes. Networks with this preference 
show large r assortative . 



D. Estimation of rich-club coefficient 



We estimate reich-club coefficient, for both initial networks and optimized networks. 



According to the previous studies 



24. 



26 



$(fc) 



28[, the coefficient for each degree k is calculated as 
2E>k (5) 



where E > k represents the number of edges among N>k nodes that have more than k degrees. As 



in previous studies 



27J, |28|, we calculate normalized rich-club coefficients, $ Jlorm (fc) through 



dividing the raw value, by the mean of rich-club coefficients of 100 random networks (ER 

models), "I'random^), follows, 

$(Jfe) 



± r 



random 



(*)' 



(6) 



III. RESULTS 



A. Rewiring-based optimization 

Fig. Q] shows representative results of the rewiring-based optimizations. (S) was decreased 
from approximately 6.5 x 10~ 2 to 4.5 x 10~ 2 even when the initial network structure was 
different. In all the initial networks, (S) reached to a stable status after approximate 400 steps 
of rewiring. Strikingly speaking, we cannot guarantee that the optimal network was found, 
but this result suggests that a reasonably robust approximation of the optimal topology was 
obtained in this method. 

During the optimization, the standard order parameter, r, were fluctuating just below 1 
during the optimization (a small panel in Fig. [I] A). The local synchonizability, rwa,i, showed 



the similar fluctuation below 1. Considering the previous studies on these parameters [32j, these 
behaviors of r and ri oca i are considered to be related to the amount of the coupling strength, 
e. The previous studies 32J have demonstrated that, when the coupling strength is more than 
0.2, both of r and ri oca i reach a plateau that is near to 1 regardless of network topology. In 
the present study, the coupling strength, e, was set at 0.3, because global synchronization is 
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necessary for the estimation of (S). This relatively large coupling strength could result in the 
saturation of the global and local order parameters, r and ri oca i during the optimization process. 

Fig. [T]B shows that the optimized networks for the three different initial networks commonly 
exhibit a characteristic topology, which has a densely interconnected core nodes and peripheral 
nodes dangling the core module. The heterogeneous network features were also observed in 
the basic network properties in the optimized networks (Tab. [I]). Compared with the initial 
networks, the optimized networks tended to show larger averaged values of the shortest path 
length, (£), betweenness centrality, (b), and degree correlation, r assortativ0 . The averaged values 
of the clustering coefficients, (C), were smaller in the optimized networks. These results suggest 
that, through the optimization process, the network seems to enlarge its heterogeneity. 



B. Rich-club organization 

This heterogeneous network topology has been reported as "rich-club" organization in a 



series of previous theoretical and experimental studies |24j, l26M28| . The prior literatures have 
characterized the organization by estimating normalized rich-club coefficients, $> noTm (k) de- 
scribed in Eq. If the network has rich-club organization, $ noim (l;) should be more than 1, 
and increase monotonically as k increases. 

Fig. [2] shows the comparison in $ norm (l;) between initial networks and optimized networks. 
To clarify the difference in the rich-club coefficients, we adopted as the initial networks larger 
networks than shown in Fig. [1] B (i.e., N = 100, (k) = 4). Before the optimization, $ norm (l;) 
was not always larger than 1 (e.g., ER and WS models), and did not show monotonic increase 
along k, which is consistent with a previous study j^]. In contrast, in the optimized networks, 
the rich-club coefficients were larger than 1 in almost all the range of k, and monotonically 
increased as k increased. These phenomena were observed commonly among the three different 
optimized networks that were derived from the three different initial networks. In addition to 
the appearance of the networks in Fig. [1] B, this estimation of $ nor m(^) supports the notion 
that the networks with rich-club organization has the minimum or a very small amount of 
synchronization cost due to phase difference among frequency-synchronized oscillators. 
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C. Bimodal Degree Distribution 



As shown in Fig.[T]B, the rich-club network topology consists of high-degree nodes cluster and 
low-degree peripheral nodes. Therefore, we hypothesized that the topology can be characterized 
by a bimodal degree distribution. To test the hypothesis, we estimated Wolfson's polarization 
index, P |35|. The Wolfson's index for degree distribution is defined as: 

P= 2 -^(2((k) 2 -(k) 1 )-G), (7) 

where (k) is the mean of the degree, ki, and m denotes the median of the degree. and 
(k) 2 are the mean values of {ki | ki < m} and of {k^ | ki > m}, respectively. G represents Gini 
inequality index, which is defined as G = 5^ = i YljLi \ h — kj |. This Wolfson's polarization 
index shows the extent of the bimodality of the distribution. If the distribution is completely 
the same as a uniform distribution, the P is 0. If the half of population has nothing and the 
other half shares everything, the P reaches a maximum, 0.25. In the present case, a larger P 
indicates that the network has a more bimodal and bipolarized degree distribution. 

We estimated P during the rewiring-based optimization. Because P can be calculated more 
accurately for networks with more nodes, we used the BA model with N = 100 and (k) = 4 
as an initial network for the optimization. As a result, in the course of the above-mentioned 
optimization, (S) decreased during the rewiring-based optimization (Fig. [3A). Meanwhile, as 
(S) decreases, P increases (Fig. [3)3) . Actually, the degree distribution changed from a power- 
law distribution (Fig. [3D) to a bimodal distribution (Fig. |3p). This relation was also observed 
for different initial networks (e.g., ER model). This correlation supports the hypothesis that 
rich-club network with small (S) can be characterized by its bimodal degree distribution. 



D. Analytical Interpretation 

We finally provide an analytical interpretation on why the rich-club network has less (S). 
Using mean-field approximation, the Eq. ([1]) in the frequency-synchronized status can be de- 
scribed as Q = Ui — ekisin(6i — ip), where ip is defined in the Eq. (J3j). Therefore, if \9i — ip\ is 
small enough, 9i — ip = -^-(ui — Q), and (6i — 6j) 2 is described as 

(o fl y (^-^) 2 , (^--^) 2 2{u l -n){uj 1 -n) 

{9i -° j) = ^kT + ^k? ^k~k 3 ' (8) 
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for a set of {oJi}. (Sij) is obtained as averaged — 9j) 2 across an enough number of sets 
of {uji}. As in the above- described numerical estimation, we assume that [uji] is distributed 
according to the normal distribution with a mean of uq and a standard deviation of a, and that 
the synchronized frequency is always Q in every set of {ui}. Because we can also assume that 
ujq is nearly equal to Q, ({oji — VL) 2 ) is considered to be equal to a 2 , and ((cjj — fl)(ojj — Q)) is 
considered to be equal to zero. Consequently, we obtain the approximation of (S^) as follows: 

(4) = ^(p + A)- (9) 

This approximation was validated through comparison of (Sij) with the real (Sij), as shown 
in Fig. 0] A (<r = 1, e = 0.3). The two parameters had a large negative value of Pearson's 
correlation coefficient (—0.88). 

This expression of (Sy) gives qualitative explanation on relationship between rich-club net- 
work topology and a small value of (S): To achieve a small amount of (S), (Sy) should be 
small. When the node i has a high degree, it makes more contribution to a smaller (S^) to 
connect with a the node j with a high degree. It is also case when the node i has a small 
degree. As a result, for a small value of (Sij), high degree nodes should connect with other 
high degree nodes, and low degree nodes should not have edges with other low degree nodes, 
but with high degree nodes. Consequently, high degree nodes tend to be gathered and create a 
densely-connected core module, and low degree nodes tend to connect with high degree nodes 
in the core module. Overall, the optimized network with a small amount of (S) is likely to be 
a rich-club network. 

Note that it is difficult to further extend this approximation. If this approximation of (Sy) 
is accurate enough, a simple calculation of Eq. |9] leads us to the proportional relationship 
between (S) and wc Given (A;) is a constant value as in the present study, (S) should be 
proportional to However, as shown in Fig. H]B, we could not observe a linear relationship. 
This inaccurate approximation of (S) may be caused by accumulation of the small difference 
between (S^) and (Sij). This result suggests that we cannot extend this approximation to 
represent (S) only by (|). 
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IV. DISCUSSION 



The present study introduced synchronization cost based on phase difference among 



25 



we showed 



frequency-synchronized oscillators. Using the rewiring-based optimization 
that the synchronization cost is minimized in a rich-club network topology. Furthermore, we 
demonstrated that the network topology can be characterized by the bimodality of its degree 
distribution. Finally, we provided analytical explanation on why the rich-club network topology 
is associated with a small amount of synchronization cost. 

The concept of synchronization cost is not a novel idea of the present study. As described 
in Sec. [J a line of previous studies have investigated a different type of synchronization cost, 



which is based on coupling strength 17H19|. Whereas the present synchronization cost due to 



phase difference can be regarded as dynamic cost per unit time, the cost based on coupling 
strength can be considered as static cost that is related to building and maintaining of net- 
work infrastructures. Interestingly, the optimal network topology with the least cost depends 
on which of the two types of synchronization cost we adopt. The optimal networks for the 
synchronization cost based on coupling strength often show more homogeneous properties 
than those for the other synchronization cost. The homogeneity of networks is desired to en- 



hance synchronizability 25|, |37|. Therefore, it may be necessary to investigate what network 



structures balance these two types of synchronization cost. 

The present synchronization cost in the present study can be another concept of load as- 
signed to edge in a complex network. Previous studies used edge-betweenness as edge load 



3n 



which is useful in various situations from human interaction 



in computer networks 



38 



39| to data transmission 



|. However, because the edge betweenness does not consider synchrony 
in networks, its properties have evident difference from those of the synchronization cost. For 
example, as shown in Sec. IIII D[ the synchronization cost is lower between high degree nodes, 
and higher between low degree nodes. In contrast, the edge betweenness tends to be higher 
in edges bridging high degree nodes and be lower in edges bridging low degree nodes. These 
distinct properties suggest the possibility that the synchronization cost can be another concept 
of edge load. 

The synchronization cost in the present study, SL-, has a mathematical expression similar to 



that for local synchronizability, 7"i oca i 



32] . However, the two parameters focus on different phases 



of synchronization in complex networks. The local synchronizability enables us to quantify 
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the local construction of the synchronization pattern. Therefore, it is useful to investigate 
properties of networks that are not yet fully synchronized. In contrast, the synchronization 
cost in the present study can be only estimated in fully-synchronized networks. Therefore, in 
the present study, we used a relatively large coupling strength, and achieved full synchronization 
throughout the optimizations. As a result, in the present study, the local synchronizability was 
always saturated. 

Although the present study did not adopt models specific to any real networks, the findings 
may help understanding large-scale brain networks. Recently, a few of recent studies have re- 
ported the existence of the rich-club organization in the large-scale brain networks. A previous 
empirical study has demonstrated the existence of the rich-club organization in the large-scale 



human brain networks 



28 



. Another study has investigated the anatomical connectivity in 



the cerebral cortex of cats, and has showed that rich-club organization controls the dynamic 



transition of synchronization in the brain 24[. A recent review has suggested that the orga- 



nization is a cost-effective network topology for the brain networks, which are required to be 



adapted to various cognitive functions 



40|. In addition to the context of cost-effectiveness, the 



rich-club network topology is robust to random attack [41]. This previous study analytically 
and numerically demonstrated that networks robust to random attack have similar structures 
observed in the present study. The robust networks highly-interconnected hub modules and 
peripheral nodes (leaf nodes) that have a single edge. This network topology has bimodal 
degree distribution and shows rich-club organization. Considering these prior literatures, it 
is suggested that the rich-club organization is beneficial for the large-scale brain networks to 
efficiently and robustly maintain its wide range of functions based on synchronization. 
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FIG. 1: (Color online) A. Main panel: Change of the synchronization cost, (S), during rewiring-based 
optimization. Despite different initial networks (ER, BA, and WS models) with N = 50, (k) = 4, the 
synchronization cost converge to a similar amount of (S) . Sub panel: Change of the standard order 
parameter, r, during the optimization. In contrast to (£), the standard order parameter does not show 
notable change, just fluctuating below 1. The line shows the change of r when the initial network is 
the BA model. In cases of the other two initial networks, the similar fluctuations were observed. B. 
Network topology optimized from different initial networks. Optimized networks are similar to each 
other. They have rich-club network topology, which consists of a densely-connected core module and 
peripheral low degree nodes connecting with the core. The color in the nodes represent the degree of 
the nodes: darker nodes have more edges. 
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FIG. 2: Difference in rich-club coefficients between the initial networks (circles and dashed lines) 
and optimized networks (multiple marks and solid lines). While the normalized rich-club coefficients 
^norm(^) do not show monotonic increase in the initial networks, those in the optimized networks 
monotonically increase. These results suggest that the rewiring-based optimization changes the initial 
networks to networks with rich-club organization. To clarify the difference between before and after 
optimization, we adopted larger networks (N = 100, (k) = 4) than in Fig. Q] (TV = 50, (k) = 4). 
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FIG. 3: As the synchronization cost, (S), decreases in the rewiring-based optimization (panel A), the 
Wolfson's polarization index, P, increases (panel B). This relation suggests that the rich-club network 
with a small amount of the synchronization cost can be characterized by bimodal degree distribution, 
which is quantified by Wolfson's polarization index. Indeed, the degree distribution changed from 
a powerdaw distribution (panel C) to a bimodal distribution (panel D). To clarify the difference 
between before and after optimization, we adopted larger networks (N = 100, (k) = 4) than in Fig. [1] 
(N = 50, (k) =4). 



A 



xlO" 



B 



xlO" 




xlO 



-3 



0.2 0.6 1.0 1.4 1.8 



13 




0.132 



0.140 



FIG. 4: A The analytical approximation of synchronization cost, (Sij), is predictive of the real 
synchronization cost, {Sij), in the BA model with ./V = 200, (N) = 10. B Simple calculations using 
(Sij) suggest a positive linear relationship between (S) and (-r). However, there is not a strong 
correlation between them, which suggests a limitation of the approximation. 



TABLE I: Basic topological properties of the optimized networks. Despite different initial networks, 
the optimized networks had similar network topological properties. The values for the initial networks 
represent averaged values across ten estimations, whereas the values for the optimized networks show 
the mean ± s.d. across the ten estimations. 

{£) (C) (b) fassOTtativc 

initial optimized initial optimized initial optimized initial optimized 
From ER models 1.9 3.5 ± 0.025 0.21 0.13 ± 0.010 44 122.2 ± 3.7 0.034 0.25 ± 0.12 
From BA models 1.8 3.3 ± 0.021 0.33 0.15 ± 0.012 48 113 ± 2.8 -0.15 0.28 ± 0.021 
From WS models 2.3 3.1 ± 0.017 0.62 0.16 ± 0.010 63 105 ± 2.4 0.047 0.25 ± 0.011 



Appendix A: Definition of Synchronization Cost 



In this section, we explain why power loss consumed in the electric line between power plants 



can be represented by square of difference in phase_p 
In the following model, as in previous studies 



' voltage between the two power plants. 
2211 , we do not consider the effect of the 



length of the power line on the power loss. To estimate the power loss in a typical power line 



shown in Fig. El we estimate active power flow [P^ and Pji), 
and delayed reactive power flow (Q ci and Q c j) as follows 1|: 



reactive power flow (Qy and Qji 



^ VMsmVi-Bj) | V 2 -V i y j cos(9 l -9 j ) ^ 
Zij 2 1 fo Lij Zij 2 / Rij 



W/;. sin (fl,_fl,) v.2_^. cos( g._^.) 

- y 2 / R + 7 2 I f T ' ^ > 

Q a = ^V 2 , (A3) 

where fo represents synchronized angular frequency of alternating voltage, and Zi 2 = R^ 2 + 
(f Lij) 2 . Pji, Qji, and Q C j are obtained by exchanging i and j. Using these power flows, the 
active power loss due to resistance, P^ ss , is calculated as P^ + Pji, whereas the reactive power 
loss due to inductance, Q\ J oss , is estimated as Qij + Qji + Q ci + Q C j as follows: 



loss 17 2 



{-2ViVj cos(0i - 63) + V 2 + V 2 ) , (A4) 



The total power loss is estimated as a combination of the active power loss and the reactive 
power loss By using a second-order Taylor expansion, we regard the total power loss, 
-P/oss + Q\i ss , as ao + ai {9i — 9j) 2 , where ao and a\ are constants (a\ > 0). Therefore, we define 
the synchronization cost, SV,-, for a power line between power plants i and j as 

S ij = (9 l -9,) 2 . (A6) 



Appendix B: Power Grid as Kuramoto Model 

In this section, we explain that, under several assumptions, we can approximate power grids 
by the first-order Kuramoto model of nonuniform oscillators. 

As previous studies Q 0,3, we model a power grid as follows: The structure of the power 



grid with N power plants is represented as an unweighted and undirected adjacency matrix A, 



where a node represents a power plant and an edge a power line. Ay is 1 when power plants 

ine between them, and A^ is when they do not. According to the 



i and j have a power 
previous studies {2, 



21 



22J, the phase of the output voltage of the power plant i, 9i, is described 



as 



ft 



W i4 



n , 2^ n , A 



sin 



(Bl) 



A ^ A 

where A denotes a damping constant, is an amount of power transfer between power plants 
% and j, and fi represents the natural frequency of the output voltage from the power plant 
i. To reduce computational cost for the following rewiring-based optimization, we assume that 
Wij/Di = e for any power line. Because fi/Di is specific to power plant i, we replace the value 
with uji. Consequently, the voltage phase of the power plants can be expressed in the Kuramoto 
model as 



ft 



UJi 



sin 



-ft 



(B2) 




FIG. 5: Panel A shows a typical power line between power plants i and j. Vi cos 9i and VjCosOj 
indicate the voltage of the output from the power plants. Rij, Lij, and Cj,- indicate resistance, 
inductance, and conductance between the power plants. As show in panel B, S is defined in every 
power line based on the phase difference of the voltages between the connecting power plants. 



